SWS:lmp 5/10/2001 P0367 EXPRESS MAIL EL818266703US 

DIGITAL WATERMARKING APPARATUS. SYSTEMS AND METHODS 

Related Application Data 
[0001] This application is related to U.S. Patent Application Nos. 09/562,049, filed 
May 1, 2000, and 09/790,322, filed February 21, 2001. This application is also related to 

PCT Application No. , filed in the United States Receiving Office on April 

30, 2001, entitled "Digital Watermarking Systems" (Attorney Docket No. P0364). 

Field of the Invention 

[0002] The present invention relates to digital watermarking systems and methods, and 
is particularly illustrated with reference to a verification system and method. 

Background and Summary of the Invention 
[0003] Digital watermarking technology, a form of steganography, encompasses a great 
variety of techniques by which plural bits of digital data are hidden in some other object 
without leaving human-apparent evidence of alteration. 

[0004] Digital watermarking may be used to modify media content to embed a 
machine-readable code into the data content. The data may be modified such that the 
embedded code is imperceptible or nearly imperceptible to the user, yet may be detected 
through an automated detection process. 

[0005] Most commonly, digital watermarking is applied to media such as images, audio 
signals, and video signals. However, it may also be applied to other types of data, 
including documents (e.g., through line, word or character shifting, through texturing, 
graphics, or backgrounds, etc.), software, multi-dimensional graphics models, and surface 
textures of objects. 

[0006] Digital watermarking techniques can also be applied to traditional physical 
objects, including blank paper. Such blank media, however, presents certain challenges 
since there is no image that can serve as the carrier for the watermark signal. 
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[0007] The surface of a paper or other physical object can be textured with a pattern of 
micro-indentations to steganographically encode plural-bit information. The texturing is 
optically discernible, e.g., by a scanner, permitting the digital data to be decoded from 
scan data corresponding to the paper object. 

[0008] There are other processes by which media can be processed to encode a digital 
watermark. Some techniques employ very subtle printing, e.g., of fine lines or dots, 
which has the effect slightly tinting the media (e.g., a white media can be given a 
lightish-green cast). To the human observer the tinting appears uniform. Computer 
analyses of scan data from the media, however, reveals slight localized changes, 
permitting the multi-bit watermark payload to be discerned. Such printing can be by ink 
jet> dry offset, wet offset, xerography, etc. 

[0009] Other techniques extend the texturing techniques, e.g., by employing an intaglio 
press to texture the media as part of the printing process (either without ink, or with clear 
ink). 

[0010] The encoding of a document can encompass artwork or printing on the 
document, the document's background, a laminate layer applied to the document, surface 
texture, etc. If a photograph or image is present, it too can be encoded. 

[0011] Printable media - especially for security documents (e.g., banknotes) and 
identity documents (e.g., passports) - is increasingly fashioned from synthetic materials. 
Polymeric films, such as are available from UCB Films, PLC of Belgium, are one 
example. Such films may be clear and require opacification prior to use as substrates for 
security documents. The opacification can be affected by applying plural layers of ink or 
other material, e.g., by gravure or offet printing processes. (Suitable inks are available, 
e.g., from Sicpa Securink Corp. of Springfield, VA.) In addition to obscuring the 
transparency of the film, the inks applied through the printing process form a layer that is 
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well suited to fine-line printing by traditional intaglio methods. Such an arrangement is 
more particularly detailed in laid-open PCT publication W098/33758. 

[0012] Digital watermarking systems typically have two primary components: an 
embedding component that embeds the watermark in the media content, and a reading 
component that detects and reads the embedded watermark. The embedding component 
embeds a watermark pattern by altering data samples of the media content. The reading 
component analyzes content to detect whether a watermark pattern is present. In 
applications where the watermark encodes information, the reading component extracts 
this information from the detected watermark. Commonly assigned U.S Application No. 
09/503,881 , filed February 14, 2000, discloses various encoding and decoding 
techniques. United States Patent No. 5,862,260 discloses still others. Of course, artisans 
know many other watermark techniques that may be suitably interchanged with the 
present invention. 

[0013] Embedded machine-readable code can be used to link to or otherwise identify 
related information. In one illustrative example, a document is embedded with an 
identifier (or machine readable code). The identifier is extracted by a watermark-reading 
device and is passed to a central server. The central server includes a database with 
related information. The related information is indexed via watermark identifiers. Such 
related information may include a URL, web address, IP address, and/or other 
information. The extracted identifier is used to interrogate the central server database to 
locate corresponding related information, such as a URL. The URL is passed from the 
central server to the reading device, which directs a web browser with the URL. 
Commonly assigned U.S. Application No. 09/571,422, filed May 15, 2000, discloses 
applications and examples of such techniques. 

[0014] An enhancement can be made to the above systems and methods. Consider an 
example where a URL points to confidential material, or to a privileged website (e.g., a 
website accessible through watermarked documents, secret, etc.). In this case, it is 
advantageous to restrict access to the corresponding website, allowing access to only 
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those users having physical possession of a corresponding watermarked document. 
Accordingly, there is a need for a verification system for use with watermark-based (or 
identifier-based) routing to websites, files, databases, networks, computers, etc. 

[0015] The foregoing and other features and advantages of the present invention will be 
more readily apparent from the following detailed description, which proceeds with 
reference to the accompanying drawings. 

Brief Description of the Drawings 

[0016] Fig. 1 shows a system according to an illustrative embodiment of the present 
invention. 

[0017] Fig. 2 illustrates an alternate communications path for the Fig. 1 system. 

[0018] Figs. 3 - 6 are flow diagrams illustrating various methods and system 
functionality according to the present invention. 

Detailed Description 

System Overview 

[0019] With reference to Fig. 1, a document 12 includes plural-bit digital data 
steganographically encoded therein (e.g., by digital watermarking). The document 12 
can be a photo ID (e.g., a driver's license, student ID, identification card, or passport, 
etc.), a value document (e.g., a banknote, stock certificate, or other financial instrument), 
a trading card (e.g., baseball card, sports card, game card, character card, etc.), a 
magazine or newspaper article, advertisement, promotional, flier, stationary, envelope, 
letterhead, product package or label, candy wrapper, a credit card, a product manual, 
business card, bank or credit account card, printed document, picture, image, registration 
card, or virtually any other type of document. (In some embodiments, document 12 is a 
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physical object such as a coffee cup, napkin ? menu, soda pop can, jewelry, hardware, 
souvenir, etc.). 

[0020] The encoding of the document 12 can encompass artwork or printing on the 
document 12, the document's background, a laminate layer applied to the document, 
surface texture, etc. If a photograph, graphic or image is present, it too can be encoded. 
A variety of watermark encoding techniques are detailed in the cited patent documents; 
artisans in the field know many more. 

[0021] In an illustrative embodiment, document 12 is encoded with a payload, e.g., 2 - 
256 bits. This payload is preferably processed before encoding, using known techniques 
(e.g., convolutional coding, turbo codes, etc.), to improve its reliable detection in adverse 
conditions. The payload preferably includes a document identifier. The document 
identifier may uniquely identify the document, or may identify a set of documents, or a 
subset of documents. 

[0022] The encoded document 12 is presented to an input device 14 for image capture. 
The input device 14 can take various forms, including a flatbed scanner, a hand scanner 
(including an imaging mouse), a video camera, a digital camera, a web cam, a digital eye, 
optical sensor, image sensor, a CMOS or CCD sensor, etc. The input device 14 is in 
communication with terminal 16. Of course, instead of being tethered to terminal 16, as 
shown in Fig. 1, input device 14 maybe in wireless communication (e.g., IF, RF, etc.) 
with terminal 16, or may be integral with respect to terminal 16. 

[0023] Terminal 16 preferably includes a general purpose or dedicated computer, 
incorporating electronic processing circuitry (e.g., a processor), memory (e.g., RAM, 
ROM, magnetic and/or optical memory, etc.), an interface to the input device 14, a 
display screen or other output device, and a network connection. The network 
connection can be used to connect to a network 22, such as an intranet, internet, LAN, 
WAN, wireless network, or other such network, to communicate with at least computers 
1 8 and 20. (Of course, terminal 1 6 may be a handheld computing device, instead of the 
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computing terminal shown in Fig. 1, such as is disclosed in assignee's U.S. Patent 
Application No. 09/842,282, filed April 24, 2001.). 

[0024] Suitable software programming instructions, stored in terminal 16's memory, 
can be used to affect various types of functionality for terminal 16. One such 
functionality is web browsing (or other communication); another is digital watermark 
reading. 

[0025] Returning to Fig. 1, terminal 16 may occasionally communicate with servers (or 
computers) 18 and 20 (e.g., via a web browser or other communication interface). 
Computers 18 and 20 maintain and execute software, e.g., for hosting (and/or supporting) 
web pages, communication, and/or database management, etc. Computers 18 and 20 also 
maintain suitable software program instructions to help facilitate the system operations 
described herein. Of course, system 10 may optionally include additional computer sites. 

[0026] Computer 1 8 can be referred to as a central server, since it preferably includes a 
repository or database of unique identifiers. In one embodiment, central server 18 
includes a plurality of servers, or a plurality of distributed servers. The identifiers are 
associated in the database (or data record, table, etc.) with related information, such as 
URLs, IP addresses, data files, multimedia files, HTML code, XML code, and/or Java 
applets, etc. The database may be directly associated with server 18, or may be remotely 
accessed. 

[0027] Server 20 preferably supports a website or other interface for internet (or other 
network) access. 

[0028] Servers 1 8 and 20 preferably communicate via a secure, session-oriented 
internet protocol ("SIP") connection. This type of connection helps to prevent 
unauthorized eavesdropping by a third party. In an alternative embodiment, servers 18 
and 20 communicate in a non-SBP fashion. In a further embodiment, as shown in Fig. 2, 
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servers 18 and 20 have a dedicated communication path through which communication is 
carried out. 

System Operation 

[0029] An example is provided as an initial overview of one aspect of the system 10 
operation. A more detailed discussion of additional aspects follows. Consider the 
following example. 

[0030] A website owner wishes to restrict access to her website. The owner would like 
to restrict access to only those users who have physical possession of a linking digitally 
watermarked document. (In this example, a linking watermarked document is one that is 
used to link, either directly or indirectly, to a website.). A computer and input device 
scans (or image captures) the digitally watermarked document. A watermark decoder 
extracts an embedded identifier from the scanned document. The watermark identifier is 
provided through a network to a central server. The central server identifies a URL 
associated with the watermark identifier and creates a verification record. The 
verification record includes a verification key and the identifier. The verification key is 
provided, along with the URL, to the computer. The computer initiates communication 
with a website corresponding to the URL, and provides the verification key to the 
website. The website communicates the verification key and a list of valid watermark 
identifiers to the central server. The central server then compares the verification key 
and list of watermark identifiers against the corresponding verification record. If they 
match, the central server signals the website to allow the computer to access the website. 
Thus, physical possession of a watermarked document is ensured and/or a user is 
authorized to access a website. 

[0031] Further aspects of the present invention are now disclosed. With reference to 
Figures 1 and 3, a digitally watermarked document 12 is presented to input device 14 
(step SI, Fig. 3). The input device 14 captures an image(s) of the document and conveys 
such to terminal 16. Executing watermark decoding software instructions (e.g., a 
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"decoder"), terminal 16 decodes the digital watermark embedded within the captured 
image data and recovers the watermark identifier (step S2). Of course, the decoder may 
be integrated into various software applications, operating system, web browser, 
independent software module, device, system, etc. Such a decoder detects and reads an 
embedded watermark (or watermarks) from a signal suspected of containing the 
watermark. In one embodiment, the decoder includes Digimarc MediaBridge software, 
available at www.digimarc.com or through Digimarc Corporation, headquartered in 
Tualatin, Oregon, U.S.A. Of course, other watermark decoding software may be used in 
other embodiments. 

[0032] The extracted watermark identifier ("ID") is provided from terminal 1 6 to server 
18 (step S3). In one embodiment, the decoder facilitates such communication. In 
another embodiment, the decoder provides the extracted ID to another software 
application (communication package, web browser, etc.), which provides the ID to server 
18. 

[0033] At server 18, the ID is processed (step S4). Preferably, such processing includes 
a step of uniquely identifying a request. Here, a request includes the extracted watermark 
ID sent to server 18 from tenninal 16. Fig. 4 illustrates one such processing method. A 
request is received in step S10. The request is uniquely identified by generating a 
random number (step SI 1). The random number is associated with a corresponding 
watermark ID and a date/time stamp (step S12). The random number, watermark ID and 
date/time stamp (referred to generally as a "time stamp") can be maintained in a database, 
table, data record and/or in another data structure. Such a table (or database, data record, 
etc.) is referred to herein generally as a response information table. The time stamp can 
identify the time of receipt, and/or the processing or response time of the watermark ID. 
Preferably, the random number is large enough to uniquely identify the request, e.g., 4 - 
256 bits. 
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[0034] Upon receipt of a request, server 1 8 preferably interrogates its information 
database to identify any related information, such as a URL or IP address, which is 
associated with the ID. 

[0035] Server 18 communicates a response to terminal 16 (step S5, Fig. 3). Typically, 
a response includes a URL (or IP address). Preferably, the response also includes 
response information, such as the generated random number and the time stamp. 

[0036] With reference to Figure 5, upon receipt of the response, terminal 16's web 
browser is directed by the URL (or other pointer) provided in the server 18 response (step 
S20). In one embodiment, the decoder controls (e.g., calls or opens) the web browser and 
provides the web browser with the URL. In this example, the URL points to server 20's 
website. In another embodiment, the decoder and web browser are integrated, or the 
decoder is a web browser plug-in. In still another embodiment, the URL is 
communicated directly to the web-browser. The response information, or a subset of the 
response information, is provided from terminal 16 to the target website, e.g., server 20 
(step S22). For example, terminal 16 provides the random number and the time stamp to 
server 20. 

[0037] With reference to Figure 1 , server 20 communicates with server 1 8, preferably 
via a secure, session-oriented internet protocol ("SIP") connection 24. Server 20 
communicates verification information via the SIP connection 24. Such verification 
information preferably includes the random number, the time stamp and a list of 
watermark IDs that are valid for the sever 20 website. The list of watermark IDs may 
include one or more watermark IDs. A valid ID is an ID that is allowed to access the 
website. (In another embodiment, a valid ID is one that is prohibited from accessing the 
website.). 

[0038] With reference to Fig. 6, server 1 8 receives the verification information in step 
S30. In step S32, server 18 determines whether the verification information (e.g., the 
random number and the time stamp) matches any of the entries stored in the response 
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information table (or database, data record, etc.) within a predetermined time period. The 
random number can be used to index into the response information table. (Alternatively, 
the list of watermarks IDs is used to interrogate the table to locate associated time stamps 
and random numbers.). Preferably, the predetermined time period is the most recent 0 - 
15 minutes. More preferably, the predetermined time period is the last 0-60 seconds. A 
typical response time may be in the range of 45-60 seconds. 

[0039] If a match is found, a positive response is provided to server 20 (via a website 
maintained by server 20), e.g., as shown in step S34. Terminal 16 is allowed access to 
the server 20 website upon receipt of a positive response. If no match is found, a 
negative response is provided to server 20, e.g., as shown in step S36, and terminal 16 is 
prohibited from accessing the website. 

[0040] In another embodiment, upon receipt of a positive verification, server 20 (via the 
website maintained by server 20) prompts terminal 1 6 for a PIN or password. Only after 
a correct PIN or password is received is the user allowed access to the website. 

[0041] Adding a random number (and optionally, a time stamp) provides enhanced 
security for linking to websites via a watermark ID. In one case, the random number 
assists in deterring would-be hackers from making redirection requests, since they must 
uses a random number matching scheme. 

[0042] For even further security, a random number can be encrypted. In one 
embodiment, the user terminal 16, and then server 20, merely passes the encrypted 
random number back to the server 1 8, where it is decrypted for verification. In another 
embodiment, encryption of the random number occurs at terminal 16 using a shared 
secret stored in the watermark decoder. Terminal 16 is directed to computer 20, and 
provides server 20 with the encrypted random number. Server 20 passes the encrypted 
random number to server 18. Server 18 then decrypts the random number using the 
same-shared secret. This embodiment helps to prevent those who gain knowledge of the 
watermark ID associated with a particular image from using an application other than an 
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authorized watermark decoder to access the secure web page. Public / Private key 
encryption is used for even more secure implementations in other embodiments. 

[0043] A time stamp can also be encrypted. Increased security is even further 
enhanced by randomly assigning watermark identifiers for related documents. Consider 
the following example. A series of baseball cards (e.g., 100 cards) are embedded with 
unique watermark identifiers. Each of the unique identifiers is randomly generated, 
instead of sequentially identifying the cards. This may help to prevent unauthorized 
access or copy based attacks on the series of cards, once an identifier or URL is 
discovered for one or more cards. 

Concluding Remarks 

[0044] The foregoing are just exemplary implementations of an online verification 
system. It will be recognized that there are a great number of variations on these basic 
themes. The foregoing illustrates but a few applications of the detailed technology. 
There are many others. 

[0045] Consider, for example, the use of embedded watermark data in a document to 
allow access to a resource. A document may be used to grant physical access through a 
normally locked door. Or a document may be used to logon to a computer network - 
with directory privileges tied to the data linked to the document. 

[0046] In some cases, the data encoded in the document fully replicates certain 
information associated with the document (e.g., the bearer's last name or initials, or OCR 
printing, or mag-stripe data, etc.). Or the encoded data can be related to other 
information on the document in a known way (e.g., by a hash function based on the 
bearer's printed name, or the full-text card contents). Or the encoded data can be 
unrelated to other information on the card. 
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[0047] In many embodiments, the data encoded in the document may serve as an index 
to a larger repository of associated data stored in a remote database, e.g., on computer 18. 
Thus, for example, an index datum read from a passport may allow a passport inspector 
to access a database record corresponding to the encoded data. This record may include a 
reference photograph of the passport holder, and other personal and issuance data. If the 
data obtained from the database does not match the text or photograph included on the 
card, then the card has apparently been altered. 

[0048] Instead of a central server generating a random number, a pseudo-random 
number, coded number, and/or a predetermined number could be generated instead, so 
long as a request is uniquely identified. 

[0049] Having described and illustrated the principles of the invention with reference to 
illustrative embodiments, it should be recognized that the invention is not so limited. In 
fact, whereas the above embodiments have been described with respect to linking to a 
URL or website, the present invention is not so limited. The inventive concepts discloses 
herein can be used to access a locked system, access a restricted file or network areas, or 
even enter a restricted area. In this case, a user terminal (or security lock) can 
communicate directly with a central computer, or via a network. 

[0050] The section headings in this application (e.g., "System Operation") are provided 
merely for the reader's convenience, and provide no substantive limitations. Of course, 
the disclosure under one section heading may be readily combined with the disclosure 
under another heading. 

[0051] While the detailed embodiments employ digital watermark technology, other 
technologies can alternatively be employed. These include barcodes, data glyphs, RFID 
devices, magnetic stripes, organic transistors, smart cards, etc. Taking as a particular 
example the document presentment concept, much the same functionality can be obtained 
by providing an RFID device in a document, and providing an RFID sensor at a user's 
computer (e.g., in a mouse pad). 
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[0052] To provide a comprehensive disclosure without unduly lengthening this 
specification, the above-mentioned patent and patent applications are hereby incorporated 
by reference. The particular combinations of elements and features in the above-detailed 
embodiments are exemplary only; the interchanging and substitution of these teachings 
with other teachings in this application and the incorporated-by-reference 
patent/applications are also contemplated. 

[0053] The above-described methods and functionality can be facilitated with computer 
executable software stored on computer readable mediums, such as electronic memory 
circuits, RAM, ROM, magnetic media, optical media, removable media, etc. Such 
software may be stored on a user terminal, and/or distributed throughout a network. Data 
structures representing the various data structures (tables, data records, databases, etc.) 
may also be stored on such computer readable mediums. Also, instead of software, a 
hardware implementation can be used. 

[0054] In view of the wide variety of embodiments to which the principles and features 
discussed above can be applied, it should be apparent that the detailed embodiments are 
illustrative only and should not be taken as limiting the scope of the invention. Rather, 
we claim as our invention all such modifications as may come within the scope and spirit 
of the following claims and equivalents thereof. 
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